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An  inequality  for  n embers  of  a  Sobolev  space  of  order  one  is  demonstrated 
and  as  a  corollary  an  upper  bound,  in  tens  of  the  Fisher  information, 
is  derived  for  a  density  function.  Also  two  characterizations  of  the 
Laplace  and  the  exponential  distribution  are  indicated. 
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»  Introduction.  Let  ||*||»»  ll'llg  denote  the  sup^  end  L2(R) 
norms  respectively,  and  let  g'  denote  the  first  distributional  deri¬ 
vative  of  the  function  g  in  I^CR)  .  We  will  demonstrate  inequalities 

► 

da)  ii*  «*nl /  iis'iii  <  iidi’  .<  iidi2  iicii2. 

and  a  generalization  thereof  (see  (2.3)),  for  members  g  of  a  Sobolev 
space  of  order  one.  Since  1  |g|  |2  ,  |  |g‘  1 12  <  ♦  •  imply  |  |gg’  1 12  <  ♦  •  , 
through  the  relations  | |ssv | ||  4  ||g|| 2  ||g'||2  <  ||g||2  ||g»||*  ,  and 
the  lower  bound  on  ||g||M  in  (1.1)  is  immediate  we  need  derive  only 
the  upper  bound.  An  interesting  special  case  of  inequalities  (1.1), 
when  f  ■  g2  is  a  probability  density  function  on  the  real  line  with 
finite  Fisher  information.  1(f)  ■  /  f,2/f  ,  is 

(1-2)  ||f»||*/I{f)  S  11*11.  *  Kf)%/2  . 

with  equality  in  the  rightmost  hand  side  if  and  only  if  f  is  the  density 
or  the  Laplace  distribution.  A  generalization  of  (1.2)  is  given  by 
(3.1)  below. 

It  should  be  noted  that  a  weaker  fora  of  the  upper  bound  in  (1.1) 
appears  in  Tapia  and  Thompson  (1978),  page  116,  for  absolutely  contin¬ 
uous  functions.  Their  proof  can  be  modified  to  achieve  the  upper 
bound  in  (1.1),  but  our  proof  allows  slightly  more  general  functions. 

2.  An  inequality  for  members  of  a  Sobolev  space.  Let  IR  denote  the 
real  line  and  let  L2  s  L,,QR)  be  the  space  of  all  Lebesque  measurable 
square  integrable  functions  g  : IR  *  |R  .  It  is  well  known  that 
(Lj  ,  <•  ,  >2)  Is  a  Hilbert  space  for  the  inner  product  <g,h>2  =  J^gh 


and  the  induced  norm  ||g||2  =  (  /R  g2)*5  .  By  a  Sobolev  space  of  order  one 
on  tR  ,  denoted  by  H  =  H*(JR)  ,  is  meant  the  space  of  all  functions 
g  :  IR  -*-R  such  that  g,g'  z  ,  where  g*  denotes  the  distributional 
derivative  of  order  one  of  g  .  Endowed  with  the  inner  product 
<**1^  5  «0<g,h>2  ♦  o1<g*,h»>2  ,  where  a  -  (Oq.o^  with  >  0  , 

and  the  induced  norm  ||g|!a  -  (<g»g>0)>1  »  H  is  a  reproducing 

m  m 

kernel  Hilbert  space  (RKHS),  i.e.  there  exists  a  unique  real  valued 
function  k(x,y)  on  IR  »  R  ,  called  the  reproducing  kernel  (RX),  such 
that. 


ky(*)  =  k(»,y)  e  H  for  all  y  e  IR  , 

and 


<g»ky>(|  -  g(y)  for  all  g  e  H  . 

The  kernel  of  H  is  given  by 

(1.1)  ka(x,y)  "  (4a0o1)“,s  exp  (-(eg/Oj^lx-yl}  . 

«* 

for  a  treatment  of  the  RKHS  and  Sobolev  spaces  the  reader  is  referred 
to  Artmssajn  (1950),  Parzen  (1967),  Gel' f and  and  Shilov  (1964)  and 
Yosida  (1974). 

We  next  derive  an  inequality  which  is  valid  for  all  functions  in 
Hl«R)  .  A  discrete  version  of  this  inequality  .is  now  available  also, 
due  to  Professor  J.  Re i Ison  (personal  communication) ,  naaely 

«**; «  (i  » <*n-vi)2)1'  • 

for  all  sequences  (gn)^|  in  *2  . 
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For  every  g  e  II  we  have 


(2.2)  I  If  I  if  <  llfll2  lifllj  • 

* 

Proof;  We  endow  H  with  the  collection  of  norms  ||*||  induced  by 

m 

the  inner  products  <•,•>  *  defined  above.  For  every  a  »  (oq.Oj)  ■  with 
a0*°l  >  0  »  (**»  is  a  11,088  **  ka  given  b>'  (2*1). 

Using  the  Cauchy«Schwarz  inequality  we  have  for  every  u  e  H 

1*00 1  -  |<ka(«.x),g(0>J  <  ||*0(*>x)||o  j|g|Io  - 

m  •  — 

{(4a0o1)-,*(o0||g||2  ♦  Oj  |  |g*  |  f2)  }**  -  {(*l)(r||g||2  ♦  1 1|)  J*5 

where  r2  »  a0/a ^  ,  for  all  aQ>ai  *  ®  •  Th®  tight  side  is  nininined 
by  choosing  r  •  | |g’ | Ij/I 1*1 l2  »  yielding  (2.2).  D 

As  a  consequence  of  the  necessary  and  sufficient  condition  for 
equality  in  the  Cauchy-Schwarz  inequality,  equality  in  (2.2)  is  seen 
to  hold  if  and  only  if  g  is  proportional  to  exp{-A|x-a|)  ,  x,a  e  R 
and  X  >  0  . 

As  a  corollary  to  Proposition  2.1  we  derive  an  analogous  result  for 
functions  defined  on  the  half-life  or  on  a  finite  interval.  Denote  by 
IMjjj  and  |M|„j  the  l2(I)-  and  supj-norns  respectively  where 
I  •  (a,b)  c  R  . 

Proposition  2.2.  Let  I  be  a  possibly  infinite  interval  (a,b)  ,  and 
let  *#*'  *  Ljd)  .  Then 

(2.3)  ||l||2fI  <  ||gj|2>1  ||g’ll2(I  ♦  0!(»)2  ♦  g(h)2)  /  2  . 

-  3  - 


Proof:  We  first  extend  g  to  gj  on  IR  ,  which  under  our  assumptions 
is  a  neaber  of  H1^)  ,  shore 

gj(x)  s  g(»)gj  tW  ♦  g(f)  ♦  8Cb)g“  b(x)  ,  X  >  0  , 

with 


for  itR  and  X  >  0  . 


Then  froa  Proposition  (2.1),  we  have 

n«iii,x  -  ii*;i 1 1  -<  n*;ii  imi2 

-  {[| 1*1 |2  *  X  C*(a32  ♦  8C«>)2)/2]-ll|g*|li  ♦  ♦  k0>)2)/21> 

-  (| 1*1 I2  11**112  ♦  (C*(«)2  ♦  *(b)2)/2)(|jg||2X  ♦  ||g«||J/X) 

♦  C(*U)2  ♦  *0>)2)/2)2}1*  , 

for  all  X  >  0  .  Hence, 

||*||2  s  (|  l*xl  I2  1 1*;*  1 1 "  ll*ll2  II*’  H2  *  ♦  gOO2)/2  . 

since  the  nininun  is  achieved  for  X  •  | (*' | l2^! 1*1 l2  *  0 

Note  that  inequality  (2.3)  is  satisfied  with  equality  if  g  is 
exponential  on  the  half-line  or  constant  on  a  finite  interval  (a,b)  . 

Also,  if  say  g(a)  -  0  ,  then  fona  (2.3)  we  have 

ll.ll!  s  Hell,  I  !»•  I  Ij  ♦.<!»’/.  <  ll.llj  ll.'llj*  II.Hl/2  . 
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which  implies 


(2.4)  Hill!  «  2||g||2  Mfllj  . 

► 

» 

For  functions  g  t  ^((O,*-))  inequality  (2,4)  can  also  be  seen  to 
hold  by  applyin*  inequality  (2.2)  to  g*(x)  s  g(x)I^^  ♦  g(2a-x)l£^aj  * 
where  1^  denotes  the  indicator  function  of  the  set  A  .  It  is  then 
clear  that,  as  a  consequence  of  the  necessary  and  sufficient  condition  for 
equality  in  the  Cauchy-Schwar z.  inequality,  equality  in  (2.4)  with 
g  c  H*((0,<m>))  holds  if  and  only  if  g  is  exponential. 

3.  An  application.  Let  f  be  a  probability  density  function  on  a  possibly 
infinite  interval  (a,b)  and  denote  by  1(f)  =  (f'  (x))2/f(x)  dx  its 

Fisher  inforaation.  Then  1(f)  ■  4||g* ||j  j  ,  where  g  *  f^  .  As  a 
corollary  to  Proposition  (2.2)  (which  covers  Proposition  (2.1),  we 
derive  the  following  inequality  involving  Fisher  information: 

Corollary  3.1.  Let  g  ■  f*1  be  as  in  Proposition  2.2.  Then 

(3.1)  supx  t  (m#b)  f(x)  <  [1(f)1*  ♦  f(a)  ♦  f(b))/2  . 

Inequality  (3.1)  may  be  modified  to  allow  for  discontinuities  of 
f  within  (a,b)  . 

Renark  3.1.  It  might  be  of  interest  to  note  the  following  two 
characterizations  of  density  functions  with  minimal  Fisher  information 
for  a  given  maximum  of  the  density  function: 

(i)  For  all  f  on  H  with  supx  f(x)  -  B  ,  I(£)  >  4B2  with 

iff  f  is  the  density  of  a  Laplace  (doubly  exponential)  distribution 
(see  the  remarks  following  Proposition  (2.1)). 


if-n 


(ii)  For  all  f  on  R+  *ith  s\xpx  f(x)  -  B  ,  1(f)  >  B2  with  - 
if  and  only  if  f  is  exponential  (see  the  remarks  following  inequality  (2.4)). 
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